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EXAMINER'S AMENDMENT 

An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided by 
37 CFR 1.312. To ensure consideration of such an amendment, it MUST be submitted no 
later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Thomas Kocovsky (Reg. No. 28,383) on March 1, 2010. 

The application has been amended as follows: 

3 . An apparatus for navigating an instrument through an anatomical 
structure of a patient's body volume, the apparatus comprising: 

a table for supporting the patient; 

at least a first C-arm having a first X-ray source and a first X-ray detector 
configured to acquire a first series of 2D-images of the instrument while manoeuvering 
through said anatomical structure; and 

a processing unit connected to a memory device, the memory device 
configured to hold pre-determined 3D-images of the patient's anatomical structure and 
hold a pre-determined 3D-model representation of the instrument: [[.]] and 

wherein the processing unit js configured to: process the 2D images of th e 
instrument and tho 3D images of tho anatomical structure to provide merged 3D imag e s 
of th e instrum e nt mano e uv e ring through said anatomical structur e , th e proc e ssing unit 

performiiig a 2D-3D registration to relate coordinates of the 
2D-images of the instrument to coordinates of the 3D-images of the 
anatomical structure prior to providing tho merged 3D images of tho 
instrument and the anatomical structure; 

wherein tho memory device holds a pro determined 
3D mod e l r e pr e s e ntation of th e instrum e nt; and 

wherein tho processing unit is configured to: 

perform a 2D-3D registration to relate the coordinates of 
the 3D-model representatio n of the instrument with the coordinates of the 
2D-images of the instrument, 

calculate projections of the 3D-model representation to 
generate 2D-model images of the instrument corresponding to the 
acquired 2D-images of the instrument, 
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modify the 3D-model representation in order to optimize 
matching of the 2D-model images to the acquired 2D-images of the 
instrument to derive an adapted 3D-model representation of the 
instrument , and 

merge the adapted 3D-model representation of the 
instrument with the 3D-images of the anatomical structure to provide tiie 
merged 3D-images of the instrument manoeuvering through said 
anatomical structure. 



4. The apparatus according to claim 3, further comprising: 

a second C-arm with a second X-ray source and a second X-ray detector 
for acquiring a second series of 2D-images of the instrument simultaneously with the first 
series of 2D-images of the instrument ; 

wherein the processing unit is configured to: 

register the coordinates of the 3D-model 
representation respective to both the first series and the 
second series of 2D-images of the instrument, and 

derive the adapted 3D-model representation 
of the instrument based on both the first series and the 
second series of 2D-images of the instrumentraad. 



7. A method for navigating an instrument through an anatomical 
structure of a patienf s body volume, the method comprising: 

acquiring a first series of 2D-images of the instrument while maneuvering 
the instrument through the anatomical structure; 

acquiring 3D images of the patient's anatomical structure: 

acquiring a 3D-model representation of the instrument; and 

processing the 2D-images of the instrument and 3D-images of the patient's 
anatomical structure to generate merged 3D-images of the instrument manoeuvering 
through the anatomical structure bv performing the steps of: , wh e r e in th e 2D imag e s of 
tho instrument aro 

r e gist e r e d with r egistering the acquired 3D- 
images of the anatomical structure with the 2D images of 
the instrument prior to generating th e m e rg e d 3D imag e s of 
tho instrument and tho anatomical structure, whoroin tho 
processing includes: 



registering the acquired 3D-modeI 
representation of the instrument with the 2D-images of the 
instrument. 
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deriving 2D-model images of the instrument 
from said 3D-model representation of the instrument , the 
2D-model images corresponding to the acquired 2D-images 
of the instrument, 

adaptin g modifying said 3D-model 
representation to optimize matching of the derived 
2D-model images with the acquired 2D-images of the 
instrument, the adaptin g modifying generating an adapted 
3D-model representation of the instrument, and 

merging the adapted 3D-model representation 
of the instrument with the 3D images of the patient's 
anatomical structure to generate the merged 3D-images of 
the instrument manoeuvering through the anatomical 
structure. 



8. The method according to claim 7, further comprising: 

acquiring a second series of 2D-images of the instrument simuhaneously 
with the acquiring of the first series of 2D-imagcs of the instrument, the second scries of 
2D-images being acquired but from a different angle compared with the first series of 2D 
images, 

wherein: 

the registering includes registering the 
coordinates of the 3D-model representation of the 
instrument respective to both the first series and the second 
series of 2D-images of the instrument, and 

the adaptin gm odifying includes 
adaptin gm odifying the 3D-model representation of the 
instrument to optimize the matching of said first series and 
second series of 2D- images of the instrument with the 2D- 
model images of the instrument derived from said 3D- 
model representation. 

11. A non-transitory computer readable medium having, stored 
thereon, computer executable software for navigating an instrument through an 
anatomical structure of a patient's body volume, the software comprising instructions for 
causing a computer to implement the steps of: 

acquirin g receiving a first series of 2D-images of the instrument while 
manoeuvering through the anatomical structure; 

receiving 3D images of the patient's anatomical structure: 

receiving a 3D-model representation of the instrument: and 
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processing the 2D-images of the instrument andthe 3D-images of the 
patient's anatomical structure to generate merged 3D-images of the instrument 
manoeuvering through the anatomical structure , the processing includin g by performing 
the steps of : 

registering the 2D-images of the instrument 
with the 3D-images of the anatomical structure-by^ 

registering [[a]]tiie 3D-model representation 
of the instrument with the 2D-images of the instrument, 

deriving 2D-model images of the instrument 
from said 3D-model representation, the 2D-model images 
corresponding to the acquir e d r eceived 2D-images of the 
instrument, and 

adaptin g modifying the 3D-model 
representation in order to optimize matching of the 2D- 
model images with the acquir e d r eceived 2D- images of the 
instrument to generate an adapted 3D-model representation 

of the instrument, and 

merging the adapted 3D-model 
representation of the instrument with the 3D images of the 
patient's anatomical structure to generate the merged 3D- 
images of the instrument manoeuvering through the 
anatomical structure. 



12. The software stored on the non-transitory computer readable 
medium according to claim 1 1 , wherein said first series of 2D-images of the instrument 
and a second series of 2D-images of the instrument are acquiro d received simultaneously, 
but from a different angle, by the acquirin gr eceiving step, and wherein: 

the registering includes registering the coordinates of the 3D-model 
representation of the instrument respective to both the first series and the second series of 
2D-images of the instrument, and 

the adaptin g modifying includes adapting the 3D-model representation of 
the instrument in order to optimize the matching of said first series and second series of 
images of the instrument with the 2D-model images of the instrument derived from said 
3D-model representation. 

14. A method comprising: 

processing 2D-images of an instrument acquired from one or more 
viewing angles during maneuvering of the instrument through an anatomical structure of 
a patient's body volume to generate 3D-images of the instrument manoeuvering through 
the anatomical structure , th e proc e ssing includin g by performing the steps of : 



Application/Control Number: 10/563,934Page 6ArtUmt: 3768 



registering a 3D-model representation of the 
instrument «t dwith the acquired 2D-images of the 

instrument, 

projoctin g calculating projections of the 
3D-modeI representation to derive 2D-model images of the 
instrument from the one or more viewing angles, and 

adaptin g modifying the 3D-model 
representation to optimally match the projoctcd derived 
2D-model images and the acquired 2D-images of the 
instrument to derive an adapted 3D-model representation of 
the instrument, and 

merging the adapted 3D-model 
representation of the instrument and a 3D-image of the 
patient's anatomical structure to generate the 3D-images of 
the instrument maneuvering through the anatomical 
structure . 



18. (Canceled) 

20. A non-transitory computer readable medium having, stored 
thereon, computer executable software comprising instructions for causing a computer to 
perform the method of claim 14. 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JACQUELINE CHENG whose telephone number is 
(571)272-5596. The examiner can normally be reached on M-F 10:00-6:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Long Le can be reached on 571-272-0823. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Jacqueline Cheng/ 
Examiner, Art Unit 3768 



/Long V Le/ 

Supervisory Patent Examiner, Art Unit 3768 



